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Abstract 

Schlieren deflectometry aims at characterizing the deflections undergone by refracted incident 
light rays at any surface point of a transparent object. For smooth surfaces, each surface location 
is actually associated with a sparse deflection map (or spectrum). This paper presents a novel 
method to compressively acquire and reconstruct such spectra. This is achieved by altering the 
way deflection information is captured in a common Schlieren Deflectometer, i.e., the deflection 
spectra are indirectly observed by the principle of spread spectrum compressed sensing. These 
observations are realized optically using a 2-D Spatial Light Modulator (SLM) adjusted to the 
corresponding sensing basis and whose modulations encode the light deviation subsequently 
recorded by a CCD camera. The efflciency of this approach is demonstrated experimentally on 
the obsevation of few test objects. Further, using a simple parameterization of the deflection 
spectra we show that relevant key parameters can be directly computed using the measurements, 
avoiding full reconstruction. 



1 Introduction 

Schlieren deflectometry aims at characterizing transparent objects by studying the deflections un- 
dergone by refracted incident light rays at any point of their surface point [I] . Compared to other 
characterization techniques relying on interferometry, deflectometry is also insensitive to vibrations 
which makes it very attractive for industrial deployment [e.g., for quality control). 

Consider a (thin) transparent object shined on one side with a beam of parallel light rays, 
as shown in Fig. [T|left). At each surface location p, the refracted light is deviated in multiple 
directions characterized in a local coordinate system (61,62,63), with 63 parallel to incident light 
beam. Using the spherical coordinates {9, ip) in this system (see Fig.[T]^left)), the resulting deflection 
spectrum Sp{0,ip) G M_|_ represents the flux of light deviated in the direction {9,(p). The evolution 
of deflection spectra along the object surface encodes information about its local curvature. This 
is why deflectometry is often used for characterizing transparent object surfaces. 

In this paper, st, is conveniently represented by its projection in the Up = 6263 plane, i.e., 
according the projected function Sp{r{9),ip) = Sp{9,(p) with r{9) = tan^. Moreover, the object 
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Figure 1: Left, illustration of a deflection spectrum. Right, a typical (projected) deflection spectrum Sp for a piano 
convex lens of optical power 25.12D. 

surface is assumed sufficiently smooth for being parametrized by a projection of p in the same plane 
(on a arbitrary fixed origin), so that p is basically a 2-D vector. 

For most objects {e.g., with smooth surfaces) defiections at any location p occur in a limited 
range of angles. The deflection spectra therefore tend to be naturally sparse in plane Hp or in some 
appropriate basis of this domain {e.g., wavelets). Fig. [T]^ right) shows an example of a discretized 
deflection spectrum Sp for one location of a piano convex lens obtained using the setup described 
in Sec. [2j The white spot in the image signifles that deflections occur at only a few angles (as 
governed by classical optics) and deflections elsewhere are negligible. 

Measuring a deflection spectrum Sp for every p is not straightforward. The optical setup 
described in Sec. [2] measures them indirectly by optical comparison with a certain number of 
programmable modulation patterns. To maximize the amount of information collected in this 
process, we exploit the sparse nature of spectra in each plane Hp and use the framework of spread 
spectrurr^ compressive sensing [2], described in Sec. |4j From a flne calibration of the system 
relative to its intrinsic noise, our approach is then experimentally validated using deflectometric 
measurements and the numerical spectrum reconstruction results are presented in Sec. [5] Further, 
from the possibility of performing signal processing in the compressed domain [3l S] , we also show in 
Sec. [6]that for localized deflection spectra summarized by a few optical parameters {e.g., location 
and width of the main peak) the compressed optical observations themselves can be processed. 
This is aimed at extracting the relevant information at a smaller number of measurements than 
those required for a full spectrum reconstruction. 

2 Optical setup and Notations 

Deflection spectra can be measured by the Schlieren deflectometer represented in Fig. [2j Its key 
components are (i) a Spatial Light Modulator (SLM), (ii) the Schlieren lens with focal length /, 

^ "Spread Spectrum" is not related to the studied deflection "spectrum" but it refers to the signal frequency 
spectrum. 
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Figure 2: A 2-D schematic of Schlieren deflectometer. 



(Hi) the Telecentric System (TS) and (iv) the Charged Coupled Device (CCD) camera collecting 
the light. 

The object to be analyzed is placed in between the Schlieren lens and the telecentric system. It 
is shined on its left by a light source and, thanks to the telecentric system, only the parallel light 
rays emerging out from the object are collected by the CCD. Moreover, up to a flipping around the 
optical axis, each location p on the object, at a distance r from the optical axis O (dashed line), 
is probed by a corresponding CCD pixel also at a distance of r from O. Each location p is thus 
in one-to-one correspondence with a CCD pixel and we will sometimes consider p as CCD pixel 
location. 

From classical optics, a light ray that is incident on location p at an angle 9p originates from 
the light source at a distance of Ax = ftanOp from the optical axis. Likewise, the light rays 
originating at different locations on the source have different incident angles at p. Since we can 
always virtually invert the light propagation in the system, everything works as if the object was 
shined on its right by a beam of parallel light rays. Therefore, up to a global scaling by /, the 
SLM plane is actually the local plane Hp of the deflection spectrum occurring at p. Modulating 
the SLM corresponds to modulating Sp, while the light collected in CCD pixel p is just an inner 
product of Sp with the modulation. 

If we generate M such modulations G with 1 < i < M in the SLM of N pixels, considering 
the discrete nature of the CCD camera (having Nq pixels), the discretized deflection spectra are 
observed through 

yfc = *Sfe + n, l<fc<iVc, (1) 

where = (0i, • • • , c/jm) e M^^*'^ is the sensing matrix, A; is a CCD pixel index, Sk G is 
the discretized spectrum at the k^^ pixel/object location, and n models the measurement noise 
(assumed Gaussian). Notice that the SLM and the CCD 2-D grids are represented as 1-D spaces 
in order to ease the notation, so that $ is then a sensing 2-D matrix acting on 1-D vectors. 

The quest now is to optimize the design of $ in order to maximize the spectrum information 
captured in each Uj., i.e., using Compressed Sensing theory. 
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3 Prior work 



A well known example of inner products based imaging system is the Rice University's single pixel 
camera [5] . This camera uses a single photosensor to capture the inner products between the scene 
to be imaged and random binary modulation patterns, realised using a micro-mirror array. In 
our deflectometric system, each CCD pixel behaves like a single pixel camera, which poses a great 
computational challenge for reconstruction. We can notice also that a binary SLM modulation 
for compressive imaging is also advocated in [6j for performing random convolutions of images. 
However, this method modulates the Fourier transform of the signal of interest and not its spatial 
domain representation. 

The previous use of Schlieren Deflectometer is in the Phase Shifting Schlieren (PSS) system. 
PSS quantitively measures the deviation angles from the deflectometric measurements, by assuming 
single deflection for each object location. It overcomes several calibration issues of the traditional 
deflectometry by using multiline phase shifted spatial filters in the SLM [7]. In this case, the CCD 
pixel values directly encode the deviation angle of the corresponding object location k. By 
making several measurements with phase shifted sinusoidal modulations as the deviation angle 
is then numerically decoded from the y/^, using n-step algorithms [8]. PSS has been successfully 
used in tomographic applications such as refractive index map reconstruction [UJ [TU] . However, the 
phase shifting method is unable to recover the full deflection spectra or to estimate several main 
deflection angles per point. Moreover, the use of non-binary modulation patterns brings in the 
problem of non-linearity in the SLM response. This is one of the reasons why we advocate using 
binary modulation patterns as described in Sec. [5] 



4 Spread Spectrum Compressive Sensing 

Compressive Sensing (CS) shows that any signal x = € C^, having a sparse representation in 
an orthonormal sparsity basis ^ G C^^^ , i.e., ||f>:||o := #{j : aj ^ 0} < K <^ N , can be tractably 
recovered from a few corrupted linear measurements of the form 

y = r^*a + n, (2) 

where * denotes the conjugate transpose, T € C^^^ is an orthonormal sensing basis, Tq is the 
submatrix formed by restricting the columns of T to those belonging to $7 C [N] := {1, • • • ,N} 
and n is a Gaussian noise vector. 

In particular, if 0, has size M and is drawn uniformly at random in [N], and if T and ^ are 
incoherent, meaning that the coherence fx := \/]V maxi<jj<jv \ {Tj,il)j)\ is very close to 1, then, 

M = 0{fi^Klog'^{N)) 

measurements are enough to recover a good estimate of x [11]. This reconstruction is performed 
by solving the following convex optimization 

S := argmin ||5||i subject to \\y — $5||2 < e, (3) 

where $ = T^'J', and e is a bound on ||n||2 < e. Under the previous conditions, the theory guantees 
that [12] 

||«-S|b = 0(^^-^ + e) (4) 
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holds with a probability at least 1 — N~^^°^^^^\ where ax is the best i^-term approximation of 
the vector a. 

As shown above, the number of the measurements scales quadratically as fx and hence it is 
desirable to have the two bases as incoherent as possible to make close to 1. In order to cir- 
cumvent this problem, [2] cleverly makes the sensing and sparsity bases incoherent by a simple 
pre- modulation, or spread spectrum, of the data vector x. This technique is optimal for universal 
sensing basis, i.e., when all the entries of $ have the same complex amplitude, which is the case 
for Fourier and Hadamard bases. 

Mathematically, with random modulation, the sensing matrix becomes $ = TqM^, where 
M = diag(m) is a diagonal matrix whose diagonal is a random vector m such that \mi\ = 1, e.g., 
a Steinhaus or Rademacher sequence. In this case, we need 

M > CpKlog^{N) 

measurements in order to recover a solution a* of ([s]) satisfying Q with a probability at least 
1 — 0{N~f), for some < p < log'^(A^). Noticeably, the coherence has disappeared from the 
condition implying that with spread spectrum and universal sensing basis, the recovery guarantee 
is universal, irrespective of the sparsity basis. We see in next section how to exploit the spread 
spectrum method in our optical setup. 

5 Deflection Spectrum Reconstruction 

We propose to combine the Schlieren deflectometer of Sec. [2] with the spread spectrum CS principles 
described above. 

Optical Sensing: Since it is essential to have real valued sensing basis and spread spectrum vector, 
as allowed by [2J, we use the Hadamard (universal) basis H for sensing, with HH^ = H^H = Id 
and Hal S combined with a random Rademacher vector m, i.e., rui = ±1 independently 

with equal probability. 

Since the SLM accepts only positive values, once the random set C [N] has been drawn, the 
corresponding sensing matrix $ = HqM must be suitably biased and scaled as 

¥=i(* + i^i?;)e{o,i}^^x^, (5) 

where Iat G {1}^ is the vector of ones. The choice of Hadamard makes the biased sensing binary. 
This has interesting advantages in the optical setup since it avoids any non-linear response of the 
SLM for non-binary values. 

Moreover, thanks to an extra measurement of each s^, i.e., the value = {iN^^k) obtained 
by an entirely transparent SLM, any measurement vector = can be debiased by 

:= = 2yf, - Zk 1m- (6) 

Up to a correct evaluation of the noise, which corrupts y^, zj. and the debiasing process ([6]), we 
can therefore reconstruct from the unbiased y^. 

Noise estimation: If there is no test object, then by classical optics the measured deflection 
spectrum is constant in all CCD pixels and corresponds to a simple disk centered on the origin 
of the spectrum domain. We denote it as s"^". The disk diameter is proportional to the pinhole 
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Figure 3: Left, an example of reconstruction using full set of measurements and right, only 10% of measurements. 



diameter of the system (see Fig. [2]). This prior information aids us in cahbrating the system and 
in estimating the noise level on the measurements. 

From actual measurements in the absence of test object, we obtain, on an arbitrary CCD pixel, 
yXio _ ^^^no _|_ _j_ where and Uy are the unknown signal and observation noises. After 
a small calibration of the SLM origin, and up to a small optimization of the disk height in s^°, 
we can therefore compute a bound on the noise power as e = H^rig + riyW = \\y^° — We 
can either obtain this value for every M or estimate it for M = N only and scale the result as 
e{N) = \/M + 2^/M e{M)/VN for M < N. 

Reconstruction Method: For the reconstruction, we select the Daubechies 9/7 wavelet basis 
as our sparsity basis [13j. This offers a sparser representation of the deflection spectra than the 
canonical (Dirac) basis. To reconstruct the deflection spectrum at any location k, an estimate of the 
sparse wavelet coefficients is obtained by solving ([s]) with the e estimated above. The spectrum 
is then estimated by = ^*Sfc. To solve ([s]), we used the Chambolle-Pock algorithm, a first order 
primal-dual method for solving convex optimization problems using proximal operators |14| . 

For evaluating compressive reconstruction performance, ([s]) was solved with M = N measure- 
ments to obtain the reference reconstruction s^. Reconstructions for M < N were compared with 
Sfc using the (output) Signal-to-Noise Ratio oSNR := 20 log^odl^felb/Pfc — ^fclb)- 

Experimental Results: For experimental evaluation, we considered two piano convex lenses of 
optical powers 10.03D and 60D, and restricted the size of spectrum to 64 x 64 centered around 
the SLM origin, resulting in = 4096. For 5 CCD locations, 10 independent reconstruction trials 
were performed for several values of M, by randomly drawing a new Q C [N] every time. 

Fig. [sj^left) shows a deflection spectrum reconstructed using the full set of measurements for 
the lens with 60-D optical power and Fig. [sj^right) shows the reconstruction with 400 measurements 
{M/N ~ 10%). Note that the spectrum is well localized, corroborating our initial observation. 
Fig. [4] shows the plot of oSNR versus the number of measurements M/N (in %), averaged over 
the trials and locations. The performance curves for both the lenses almost overlap, and the 
oSNR improves as M/N increases. Though the absolute values of oSNR seem low, its significance 
has be understood in the light of the input SNR, which is approximately computed as iSNR := 
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Figure 4: Average reconstruction oSNR (in dB) as a function of Al/N . 



201ogio(||*s'^°||2/||y''° - *s°°||2) — 4.34 dB. The horizontal dotted hne on the plot indicates the 
iSNR for our experiments, and it is clear that the reconstruction procedure improves the oSNR, 
beyond the iSNR, thereby demonstrating the abihty of CS reconstruction of deflection spectra in 
low input SNR regime. 

6 Deflection spectrum characterization 

Suppose we are interested in summarizing the deflection spectra by a few parameters that charac- 
terize them at each location. For example, we could summarize a spectrum by the location of the 
bright feature it contains. To address this, we propose the following robust method to localize the 
feature. 

Assuming that the feature is circular and its radius p can be known a priori, the feature can 
be localized using a matched filter. To this end, we employ a template Gp, which contains a two- 
dimensional Gaussian of width p at its center. To localize the feature in a spectrum we simply 
translate Gp over the support of the spectrum and find the best translation f G that maximizes 
the correlation between the spectrum and the translated template T^Gp. By letting Qr to denote 
the vectorized form of T^Gp, we solve 



With an abused terminology we designate the translation parameters f as the centroids of the 
spectral features. These centroids also provide local information about the mean deflection angles 
at various locations. 

In order to characterize an object using the centroids defined in ([T]), we have to reconstruct 
the spectra at all Nq locations individually and then compute the centroids, which requires huge 
computational time. It essential therefore to explore the possibility of computing the centroids 
right from the measurements y^, without even reconstructing the spectra. 

Davenport et al. have proposed the idea of performing common signal processing tasks such as 
detection and classification using the compressive samples obtained using random measurements j3l 
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Figure 5: Average error in centroid estimation (in pixels) using compressive measurements, as a function of rmmber 
of measurements, in %. 

3]. In the same spirit, we compute the centroids directly from the measurements y^. defined in ([6|. 
To accomplish this compressive centroid estimation, we carry the definition of the centroid of the 
spectrum ([T]) into the measurement domain and solve 

Tfc = argmax \ {^'^yt,,gP.)\. (8) 

T 

Notice that solving ([s]) is the same as solving ([T]), but instead of using s^, obtained by solving ([3]), 
we simply compute ^^yk and use it for centroid estimation. 

For experimental evaluation, we retained the configuration described in Sec. [5] For each of the 
5 CCD locations k, the centroid was computed by solving ([s]). A "ground truth" centroid was 
also found by solving ([T]), with reconstructed (solving ([3])) using full M = 4096 measurements. 

Fig. [5] shows the centroid computation error ||f — f||2 as a function of the number of mea- 
surements M/N. Each data point is an average over 50 independent trials for each value of M 
and over all the locations. The horizontal dotted line indicates a unit pixel error and it can be 
seen that the compressive centroid estimation achieves sub-pixel accuracy, even with the number of 
measurements as low as 2.4% (50 measurements) for the 60D lens, and about 3.7% for the 10.03D 
lens. This demonstrates the ability of the measurements to capture sufficient information about 
the feature of the spectra. 

7 Conclusions and perspectives 

This paper presents a novel approach to perform schlieren deflectometry using compressive sensing 
principles. In contrast to the existing system, the proposed approach enables the reconstruction of 
deflection spectra, instead of a single deflection angle at each location. Although it involves compu- 
tationally intensive procedure, spectra reconstruction leads to better characterization of the studied 
object. The empirical results also demonstrate the capability of our method to perform meaningful 
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inferences about the deflection spectra using only the compressive measurements, without involving 

any reconstruction. 

Several challenges remain to be addressed in the future work. It is of foremost importance to 
fully understand the noise model to tune the reconstruction algorithm. Also, incorporating further 
priors such as non-negativity helps the reconstruction. We also intend to develop approaches to 
simultaneously reconstruct spectra, corresponding to neighbouring CCD pixels, by exploiting the 
correlation amongst them. 
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